US006304549B1 

(12) United States Patent (io) Patent No.: US 6,304,549 Bl 

Srinivasan et al. (45) Date of Patent: Oct. 16, 2001 



(54) VIRTUAL PATH MANAGEMENT IN 
HIERARCHICAL ATM NETWORKS 

(75) Inventors: Santhanam Srinivasan; Malathi 

Veeraraghavan, both of Monmouth, NJ 
(US) 

(73) Assignee: Lucent Technologies Inc., Murray Hill, 
NJ (US) 

( * ) Notice: Subject to any disclaimer, the term of this 
patent is extended or adjusted under 35 
U.S.C. 154(b) by 0 days. 

(21) Appl. No.: 08/852,892 

(22) Filed: May 8, 1997 

Related U.S. Application Data 

(60) Provisional application No. 60/026,524, filed on Sep. 12, 
1996. 

(51) Int. CI. 7 H04L 12/28 

(52) U.S. CI 370/230; 370/468 

(58) Field of Search 370/252, 254, 

370/398, 395, 397, 409, 410, 468, 450, 

230 

(56) References Cited 

U.S. PATENT DOCUMENTS 

5,029,164 * 7/1991 Goldstein et al 370/235 

5,432,783 * 7/1995 Ahmed et al 370/397 

5,519,689 * 5/1996 Kim 370/232 

5,761,192 ♦ 6/1998 Hummel 370/254 



5,764,740 * 6/1998 Holender 379/112 

5,872,918 * 2/1999 Malomsoky et al 709/220 

5,886,982 ♦ 3/1999 Kozaki et al 370/399 

5,933,412 * 8/1999 Choudhury et al 370/218 

5,940,738 * 8/1999 Rao 455/4.2 

OTHER PUBLICATIONS 

M. Veeraraghaven, M Kshirsagar, G. Choudhury, "Concur- 
rent ATM Connection Setup Reducing Need for VP Provi- 
sioning," IEEE Infocom '96, Mar. 1996. 

* cited by examiner 

Primary Examiner — Chau Nguyen 
Assistant Examiner — Jasper Kwoh 

(57) ABSTRACT 

This is a method for dynamic and distributed management of 
Virtual Path Connections (VPCs) in a hierarchical ATM 
network. VPC parameters, including VPC type 
(heterogeneous or homogeneous), source node 
characteristics, end-to-end VPC constraints (GoS and QoS), 
and the number of on-demand connections to be supported, 
are determined or specified. Network resources, such as 
bandwidth and buffer size availability, are also determined. 
The parameters and information relating to the network 
resources are sent to a connection server that computes an 
optimal physical route for the VPC, allocates resources 
along the computed route, and notifies switches along the 
route of the new allocation of resources. The switches then 
change their respective configurations to accommodate the 
new allocation. 
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VIRTUAL PATH MANAGEMENT IN (MMPP) model and the Markov Modulated Fluid (MMF) 

HIERARCHICAL ATM NETWORKS model. In the MMPP model, in any given state i of the 

Markov process, ceils are generated according to a Poisson 

RELATED APPLICATIONS process with intensity R,. On the other hand, an MMF 

_. , „ . .. ,rr^ 5 source, in state i, generates information as a continuous flow 

Tins application ^claims to benefit of proviaonal U S. (flujd) wjth ralc R , eithcr modcU , hc inte nsilies 

patent apphcat.on Scr. No. 60/026,524 filed Sep. 12. 1996. ^ r i prescnted „ \ ^ vector> \ and the ^rce is 

FIELD OF THE INVENTION characterized by the tuple [M.R]. When cells from multiple 

sources arrive at a switch, as shown in FIG. 2, the cells are 

The present invention relates generally to bandwidth 10 stored in a buffer until the destination port/link is free. Due 

management in hierarchical ATM communication networks, to finite buffer sizes and the stochastic nature of the sources, 

and more particularly, to an improved method for dynarai- buffer overflow leads to cell loss. Thus, as shown in FIG. 2, 

cally adjusting virtual path connection ("VPC) bandwidth an important QoS criteria for a connection is the Cell Loss 

allocations in hierarchical ATM communication networks. Ratio (CLR), which is the ratio of the total number of cells 

is that are dropped due to buffer overflow to the total number 

BACKGROUND OF THE INVENTION of cells that arrive at the switch, and the Cell Transfer Delay 

, , n x . , , , r (CTD), which is the time spent in a buffer, before being 

Asynchronous iranster Mode (Al M) is me tecnnoiogy oi switchcd 

out. 

choice for Broadband Integrated Services Digital Network . - t , e . . . . . , „ 

(B-ISDN), a communications standard that supports a range 9n drawback of using provisioned VPCs with Deallocated 

of data, voice, image, video, and multimedia services, with 20 ca P ac "y * that ™ l ™ k u f za ' 10n (transmission efficiency) 

different grade of service (GoS) objectives, such as call f ' educed sir ! ce ^ and n ° de resources are Partitioned 

blocking probability, as well as quality of service (QoS) ( rather tha " shared )' ™i s * ^ especially true if the 

objectives, such as cell loss probability and cell transfer ™ ce allocations to VPCs are made allowing for uncer- 

delay. This is achieved with careful resource management, taint y 10 traffic characterization. 

i.e., controlled access of network resources, such as link effect of varying traffic patterns can be sharply 

bandwidth and switch buffer resources. reduced by using a scheme which dynamically adjusts VPC 

Resource management controls can be implemented at a rcsource ^locations based on usage, 
number of levels in an ATM network. Controls can be One method for dynamically realizing changes in VPC 
applied to Virtual Channel Connections (VCCs), which are 30 routes and resource allocations is to use control plane 
connections of virtual channel links (segments of unidirec- (signaling) software on switches as is done with Soft Pro- 
tional transport of ATM cells between a point where a virtual visioned Virtual Circuits (SPVCs). This method inherently 
channel identifier (VCI) is assigned to the point where this possesses two drawbacks in that it uses a sequential node- 
value is translated or removed), and Virtual Path Connec- by-node setup and configuration procedure which may result 
tions (VPCs) which are a concatenation of virtual path links, 35 in excessive and unacceptable VPC adjustment delays and, 
which are terminated by points where the virtual path ^ther requires additional software to monitor VPCs and 
identifier (VPI) is assigned and translated or removed. FIG. miliate adjustments, on already overloaded switches. 
1 shows an illustration of VCCs and VPCs. Typically, VCCs Several other schemes for the creation and maintenance of 
are set up on demand, while VPCs are preestablished VPCs in ATM networks have been proposed. These are 
(provisioned), i.e., with bandwidth and buffer resources 40 largely optimization based schemes for assigning band- 
allocated a priori. Thus, to set up an on-demand connection, widths to VPCs such that the call blocking probability is 
e.g., a VCC from end host A to end host B in FIG. 1, minimized. These schemes involve the solution of a 
Connection Admission Control (CAC) functions and switch complex, non-linear optimization with non-linear con- 
fabric configurations are only performed at the terminating straints. Although these problems may be simplified by 
points of each VP segment, e.g., at switches SW1 and SW2. 45 using approximations, currently, the optimization is solved 
As is known, provisioning VPCs offers a number of advan- periodically in a centralized fashion and the results down- 
tages such as: reducing end-to-end VCC setup delay; use in loaded to the switches. Additionally, due to their centralized 
self-healing networks due to faster rerouting and restoring nature, these schemes do not scale well for large networks 
speeds; a reduction in network "switching" costs since VP and fault tolerance becomes a problem since the server 
cross-connects can be used in parts of the network; and, use 50 which performs the optimization could fail. Although these 
in certain applications such as IP-over-ATM networks, schemes attempt to achieve optimal call blocking 
where provisioned VPCs improve performance by avoiding probability, in reality, the approximations and simplifica- 
a connection setup to transfer connectionless IP packets tions needed to make the optimization feasible, remove any 
across an ATM network, and wireless ATM networks where guarantees of optimality. Also, since the optimization is 
provisioned VPCs between adjacent base stations allows 55 complicated, it cannot be performed often, thus further 
simplified mobile handoffs. compromising the optimality of the assigned bandwidths. 

By way of background, VPCs are of two types: Dynamic management of VPC routes and resource allo- 
homogeneous, if they only support calls of a single traffic cations can be done by continuously monitoring the network 
class, and heterogeneous, if they support multiple classes of and reacting to repeated congestion patterns, and topological 
traffic. As the underlying source model of cell arrival rates 60 changes caused by failures and additions of network ele- 
at a network connection has been shown to be reasonably ments such as links and nodes. The recently standardized 
modeled as a Markov Modulated (MM) process, the modu- Simple Network Management Protocol (SNMP) and the 
lating process may be represented as a continuous time ATM Management Information Base (MIB) currently pro- 
Markov chain with state transition rates [m^], i, j € {1, . . . , vide the basis for dynamic solutions. For instance, MIBs 
K}, represented as a matrix M. Based on the characteristics 65 reflect the current conditions of the network elements by 
of the modulated process, two types of source models are enabling network managers to communicate with agents on 
commonly used, the Markov Modulated Poisson Process network elements to read and write MIB variables in order 
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to provide dynamic management of VPCs. However, there 
are several drawbacks in performing dynamic management 
of VPCs using MIB reads and writes: First, is its inefficiency 
in a distributed solution which would require various net- 
work managers distributed throughout the network to con- 
stantly read these MIB variables from the switches thus 
negatively impacting the performance of the switch agents. 
Second, is its inefficiency resulting from writing MIB vari- 
ables to realize changes in VPC routes and resource alloca- 
tions which can be time consuming. 

Thus, besides being dynamic, the VPC management 
scheme needs to be distributed for the reason that a central- 
ized solution does not scale well with the size of the 
network, and is also very poor from a fault tolerance 
perspective. 

A distributed scheme for control of VP bandwidths has 
been proposed, e.g., in S. Shioda and H. Uose, "Virtual path 
bandwidth control method for ATM networks: successive 
modification method," IEICE Trans., vol. E74, pp. 
4061-4068, Dec. 1991. This scheme is a heuristic which 
works on the observed call blocking probability on the 
different VPs, but has drawbacks in that exactly one VPC is 
allowed between each pair of switches which is a severe 
restriction, and, the route of each VPC is precomputed and 
fixed which is not reasonable where a network state is 
constantly changing as does the "best" route between a pair 
of nodes. 

It would thus be highly desirable to aim for a solution to 
the VPC bandwidth/buffer/route management problem that 
addresses the drawbacks and shortcomings of existing 
dynamic VPC bandwidth management methods. Such a 
solution to the VPC bandwidth/buffer/route management 
problem should be scalable with respect to the size of the 
network and precludes any centralized approaches. 
Furthermore, such a solution should be robust and be 
capable of handling network state changes such as network 
element additions and failures. Moreover, such a solution 
should not assume fixed precomputed routing of the VPCs 
but rather provide for the routing VPCs according to the 
"best" paths, which could change with time as the network 
state changes. Additionally, the solution should be able to 
take advantage of existing standards and interwork with 
them. 

SUMMARY OF THE INVENTION 

Accordingly, it is an objective of the present invention to 
provide a distributed and dynamic virtual path management 
system for dynamically adjusting VPC bandwidth allocation 
in hierarchical ATM networks. 

It is also an objective to provide a distributed and dynamic 
virtual path management system that is based on switch 
connection (routing) standards, such as PNNI, that enable 
network nodes to monitor VPC bandwidth usage, make 
dynamic VPC bandwidth/buffer modifications, and set up 
and remove VPCs dynamically. 

It is a further object to provide a distributed and dynamic 
virtual path management system that implements a Parallel 
Connection Control routing protocol ("PCC) to exploit the 
inherent parallelism in the connection establishment proce- 
dure for faster VPC setup/modification. 

In accordance with one aspect of the invention, there is 
provided a method for automatically provisioning a com- 
munication channel between two switching nodes of an 
ATM network including a plurality of interconnected 
switching nodes, each switching node including at least a 
switching element and an associated switch control, the 
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method comprises: obtaining parameters characterizing a 
type of communication service capable of being provisioned 
between the two switching nodes in the network; commu- 
nicating the parameters to a first control device associated 
with a switching node in the network; communicating 
information relating to switching element resources cur- 
rently available at each switching node contained in the 
network to the first control device; from the parameters and 
switching element resource information, computing an opti- 
mal route between the two switching nodes that is capable 
of realizing said communication channel and allocating new 
switching element resources for switching elements con- 
tained in the computed route; and, communicating allocated 
switching element resources to each switch control device 
associated with a switching node along the route, each 
switch control device configuring a respective switching 
element to maintain new switching resources allocated 
thereto. 

Advantageously, the method provides for dynamic moni- 
toring of service usage along the route of the realized 
communication channel and, re-allocation of the resources 
of the communication channel for accommodating on 
demand service changes along the route. Additionally, the 
system handles network state changes such as link and node 
failures and additions and is readily adapted to take advan- 
tage of existing communications standards and interwork 
with them. 

The various features of novelty which characterize the 
invention are pointed out with particularity in the claims 
annexed to and forming a part of the disclosure. For a better 
understanding of the invention, its operating advantages, and 
specific objects attained by its use, reference should be had 
to the drawing and descriptive matter in which there are 
illustrated and described preferred embodiments of the 
invention. 

BRIEF DESCRIPTION OF DRAWINGS 

FIG. 1 is a block diagram illustrating an example VCC 
and VPC in an ATM network. 

FIG. 2 illustrates several sources multiplexed at a buffer. 

FIG. 3 illustrates the distribution of functions between 
connection server and switch resource server in hierarchical 
communicating networks. 

FIG. 4 illustrates generally the PNNI/PCC network archi- 
tecture of a peer group. 

FIG. 5 illustrates an example hierarchically organized 
network. 

FIG. 6 illustrates generally the DIVA algorithm of the 
invention. 

FIG. 7 illustrates steps implemented by DIVA for realiz- 
ing a VPC in hierarchical ATM networks. 

FIGS. 8(a) and 8(b) illustrate the various means by which 
a connection server communicates resource allocation (FIG. 
8(a)) and switch fabric configuration messages (FIG. 8(b)) 
in parallel to respective associated switch resource servers. 

FIG. 9 illustrates the relationship between allocated band- 
width and buffer size and the CLR and CTD constraints on 
the switch. 

FIGS. 10(a) and 10(6) illustrate the method for determin- 
ing and dynamically adjusting for failed or added network 
elements, e.g., links, switches, or connection servers. 

DETAILED DESCRIPTION OF THE 
INVENTION 

The instant invention is a distributed and dynamic VPC 
management algorithm, ("DIVA"), and system for managing 
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virtual paths connections in organized hierarchical net- 
works. Particularly, DIVAhas been designed to use the ATM 
Forum's PNNI routing protocol which enables information 
about the network to be gathered and disseminated in a 
scalable manner. The PNNI routing protocol such as 5 
described in The ATM Forum, Private Network-Network 
Specification Interface vi 0. Mar. 1996, is incorporated by 
reference as if fully set forth herein. 

Specifically, the PNNI routing protocol standard is 
designed for hierarchical networks in which nodes are 10 
gathered into hierarchical Peer Groups (PGs) for scalability 
reasons. In PNNI, switches within a PG exchange detailed 
network topology and network state information with each 
PG having a designated Peer Group Leader (PGL) which 
participates as a member of a higher level PG. A PGL of a ^ 
J*G Jtt leve l L represents this PG as a single fTocIe~ in the 
7 L^T)-level Fti, and is hence referred to as a logical firo up 
*no~de (LGN ) at l evel L+1/T\yo LGNs may be connected J b 
each otherSy a logical link wju cJu&^agtaej &te rep resen- 
tation of one or more link s_between the cor respondin g PGs 20 
at the lower level. PGLs obtain routing information about 
the^witches in their PGs and propagate a condensed version 
of this information to its peers in the higher-level PG. As is 
known in the PNNI routing scheme described above, the first 
switch in a PG determines the route of the connection 25 
through that PG, and following route computation, resource 
allocation and switch configurations are performed hop-by- 
hop (sequentially) at each switch on the route. In a preferred 
embodiment, to improve upon the switched connection 
setup procedure proposed in PNNI, the invention imple- 30 
rnents the Parallel Connection Control (PCC) routing pro- 
tocol enabling faster VPC setup/modification due to parallel 
connection setup at the selected switches rather than sequen- 
tial. The Parallel Connection Control (PCC) scheme such as 
described in M. Veeraraghavan, M. Kshirasagar, and G. L. 35 
Choudhury, "Concurrent ATM connection setup reducing 
need for VP provisioning," Proc. IEEE Infocom, pp. 
303-311, 1996, the whole contents and disclosure of which 
is incorporated by reference as if fully set forth herein, 
recognizes the inherent parallelism in the connection estab- 40 
lishment procedure and executes actions at a number of 
switches in parallel rather than in sequence. 

Furthermore, as shown in FIG. 3, PCC allocates some of 
the connection management functions in a functional unit 
referred to as a connection server 50, and not in the switches. 45 
Hence, the additional software for monitoring VPCs and 
initiating adjustments are moved to the connection servers. 
Remaining functions are performed by a switch processors, 
hereinafter referred to as a switch resource servers 75 as 
shown in FIG. 3. Connections spanning multiple PGs are 50 
established by executing actions at the switches within each 
PG in parallel, as facilitated by the PCC protocol 
enhancement, but proceeding sequentially from one PG to 
the next, i.e., the PNNI signaling protocol is used for 
inter-PG communication. 55 

The detailed distribution of functions between connection 
servers and switch resource servers is shown in FIG. 3. VPC 
route computation is performed by a route computation 
utility 52 running in the connection server 50. Other func- 
tions such as, the UNI (User Network Interface) signaling 60 
54, PNNI signaling 56 (for PG to PG connection setup), 
PNNI Routing protocol 58 (for communicating current 
topology state information), and the PCC protocol 60 (for 
parallel intra-PG connection setup) and the software imple- 
menting these functions are distributed between connection 65 
servers and switch resource servers as shown in FIG. 3. 
Thus, UNI and PNNI signaling are off loaded from switch 
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resource servers. PCC implementation indicates that con- 
nection servers are less loaded than switch resource servers 
allowing DIVA's VPC monitoring and adjustment initiation, 
required for VPC management, to be located in connection 
servers as indicated by VPC Management block 100 in FIG. 
3. Connection servers also initiate VPC modifications/setups 
in response to topological changes reported via the PNNI 
routing protocol messages. For this added functionality, a 
primary connection server is assigned to each switch. Any of 
the other connection servers in the same PG act as alternate 
connection servers in case of connection server failures, as 
will be described. 

Switch resource management functions 80, such as: Con- 
nection Admission Control (CAC) for buffer and bandwidth 
resource allocations; selecting incoming and outgoing VPIs/ 
VCIs for VCCs, or incoming and outgoing VPIs for VPCs; 
configuring the switch fabric by setting Port/VP I/VCI trans- 
lation tables for VCCs or Port/VPI translation tables for 
VPCs (these are later consulted by ATM cells arriving on the 
established connection for routing through the switch 
fabric); and, programming parameters for various runtime 
(user-plane) algorithms, such as cell scheduling, per VC 
queuing or per- VP queuing, priority control, rate control, 
etc., are performed by switch resource servers 75 in addition 
to some of the PNNI 58 and PCC 60 routing protocol 
functions. 

FIG. 4 illustrates the PNNI/PCC network architecture in 
which DIVA is implemented. The network consists of sev- 
eral PGs, e.g., PG U . . . , PG 3 with each PG consisting of 
switches, e.g., SW, . . . , SW^ connection servers, CS lt . . . , 
CS n and end hosts, e.g., EG^ . . . , EG A . Each switch, e.g., 
SW lf additionally consists of a switching fabric, e.g., 
switching entity SWE 1 , and a switch resource server 75 
(FIG. 3), A connection server is designated to be the Peer 
Group Leader (PGL) in each PG. For example in FIG. 4, the 
connection server CS ( is the designated the peer group 
leader, PGL, for the first peer group, PG1. The PGL selec- 
tion is done through an election process among all the 
connection servers, just as in PNNI networks. The switches 
and connection servers are hereinafter generically referred to 
as nodes. Nodes in the network communicate with adjacent 
nodes via bi-directional physical links and non-adjacent 
nodes communicate over provisioned virtual circuits or 
through datagram routers, such as IP routers. 

An example of such a hierarchically organized network is 
shown in FIG. 5. In this example, switches A.2.1, . . . , A.2.4 
and connection servers A.2.5 and A.2.6 have been gathered 
into peer group PG(A.2). Connection server A.2.5 is the 
primary connection server for switches A2.1 and A.2.2, and 
connection server A.2.6 is the primary connection server for 
switches A.2.3 and A.2.4. A.2.5 is the peer group leader PGL 
and represents PG(A.2) as the logical node A.2 in the higher 
level of the hierarchy. In its turn, A2 belongs to PG(A) along 
with LGNs A. 1 and A3, representing PG(A^) and PG(A.3), 
respectively. The logical link between A.1 and A2 is an 
aggregate representation of the links between nodes in the 
two corresponding PGs at the lower level. 

As is known, PNNI routing messages are of two types, 
Hello packets and PNNI Topology State Packets (PTSPs). 
Nodes in the network run a modified version of the Hello 
protocol. Hello packets are exchanged across each link that 
comes up and the nodes attached to the link exchange 
information to establish their identity as well as their PG 
membership. Each switch also informs each of its neighbors 
belonging to a different PG the identity of its primary 
connection server. This piece of information propagates to 
the connection servers in the adjacent PG and is used for 
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setting up connections spanning multiple PGs. Neighboring in the PG. If there is no VPC between switches SW and SW 

nodes also exchange periodic Hello packets which serve as and the number of connection setup requests over a certain 

"heartbeats" to monitor the health of the neighboring node. window of timex OTO „ /wr exceeds a threshold r max , then the 

Switches in the network create PNNI Topology State connection server 50 decides that SW and SW need to be 

Elements (PTSEs) about their local state, namely about their 5 connected by one or more VPCs. Besides determining the 

own identity and capabilities. Switches do not maintain node pairs that should be connected by a VPC, some of the 

topology state information and hence do not exchange such parameters of the VPC can also be determined from the SVC 

information with each other. Instead these PTSEs are encap- setup and release data, namely: the VPC type, i.e., hetero- 

sulated into PTSPs and sent to the primary connection server geneous or homogeneous; the source characteristics, i.e., the 

of the switch. These PTSEs also contain topology state 10 set of tuples {[M„ R,], . . . , [M^ RJ} for heterogeneous 

parameters describing the state of links associated with the VPCs with "k" classes of sources, or the tuple [M, R] for 

node in question as well as all the VPCs originating at the homogeneous VPCs; the end-to-end VPC CLR constraint(s) 

nodes. This information is used by the connection server 50 to be supported by the VPC, namely, the set {8/*', . . . , 6*/°'} 

to perform VPC bandwidth management functions in the for heterogeneous VPCs, or the single constraint Q rot , for 

VPC Management Block 100 (FIG. 3). 15 homogeneous VPCs; the end-to-end VPC CTD constraints, 

The connection servers in a PG exchange topology state namely, the set of constraints {t/°', . . . , x fr ' or }, for 
and reachability information with each other in order to heterogeneous VPCs, or the single constraint if ot for homo- 
synchronize their topology databases. Each connection geneous VPCs; and, furthermore, the determination as to the 
server reliably floods the connection servers in its PG with number of calls (on-demand connections) that need to be 
detailed information about the state of the nodes for which 2 o supported on the VPC. This parameter can either be directly 
it is the primary connection server as well as links associated specified as the set {v ; , . . . , v^} for heterogeneous VPCs, 
with these nodes. This information is used by the connection or vto for homogeneous VPCs; or, indirectly specified by 
servers to perform detailed route computation inside the PG. giving the Call Blocking Probability (CBP) constraints) and 
Also, the PGL condenses this information and floods it in its offered traffic, namely, the sets {CBPj, . . . , CBP fc } and 
PG. The PGL also receives such condensed information 25 {pi> • • ■ > P*}> respectively, for heterogeneous VPCs, or the 
about other PGs and floods this information among all the target CBP and p for homogeneous VPCs, where p^X/juis the 
nodes in its child PG if this is not a lowest level PG and offered traffic with X equal to the mean rate of calls arriving 
among the different connection servers in a lowest level PG. at a VPC and ju equal to the mean rate of calls departing from 
PTSEs in the topology databases of the connection servers a VPC, and CBP representing the probability that a call gets 
are subject to aging rules and deletion just as in PNNI based 30 blocked on the VPC when the resources available on the link 
networks. are inadequate to support the call. The type of VPC to set up 

FIG. 6 illustrates the general flow diagram for DIVA 101 as well as the CBP constraint, either system wide or for each 

implemented by the VPC management block. Particularly, node pair, are specified to the connection servers 50. 

as shown at step 105, the algorithm first determines where Apart from being decided automatically by connection 

a VPC should be laid. Largely, this is determined a priori 35 servers, VPCs may be setup based on prespecified rules, or 

based, e.g., on the communication traffic (number of calls), based on requests by the network administrator/network 

monitored between two points, However, other methods manager. As the traffic monitoring approach applies to those 

such as a rule-based approach may be implemented. If the applications where, for lack of better a priori information, 

traffic is large enough to justify the provision of a VPC connections are allowed to be set up on demand (SVCs) for 

between those two points, then the algorithm proceeds to 40 some time before the connection servers can gather adequate 

set-up or realize the VPC at step 200. In order to realize the information, through traffic monitoring, to decide that the 

VPC, however, certain parameters must be determined as volume of traffic warrants the set up of VPCs between some 

will be explained herein. Furthermore, as will be explained, pairs of nodes, for some applications, VPCs may addition- 

the realization process entails the determination of a VPC ally be configured from the very beginning between certain 

route, and, additionally, the allocation of buffer and band- 45 pairs of nodes based on a prespecified set of rules. For 

width resources for the VPC. Furthermore, the algorithm example, the connection servers can be instructed to set up 

provides a manner for monitoring VPC usage, as indicated pair- wise VPCs between each pair of nodes inside each PG. 

at steps 300 and 310, and for making any necessary on the In this case, whenever a switch joins the network, either new 

fly adjustments to VPC routes/resource allocations by or restored after a failure, VPCs are created to all other 

returning to step 200. Additionally, as part of the monitoring 50 switches in the PG. Such a rule simplifies SVC setup to 

process, DIVA 101 provides a manner for accomplishing choosing a VCI in each PG involved, and setting an entry in 

changes to VPC configurations in reaction to link and node the translation table (not shown) of each border node along 

(a) failures, and (b) additions and restorals, as indicated at the route. The rule based VPC approach is also applicable to 

steps 315 and 325. Each of these steps will be explained in IP-over- ATM networks where we can avoid connection 

greater detail hereinbelow. 55 setup to transfer connectionless IP packets by connecting 

As indicated above at step 105 in FIG. 6, DIVA may each pair of IP routers by a VPC. Another example is that of 

determine, a priori, that the volume of traffic warrants the set ATM networks supporting mobility, where having a VPC 

up of VPCs between some pairs of nodes, i.e., a pair of between adjacent base stations speeds up handoffs. In each 

switches in the hierarchical network. Specifically, the con- case, all the parameters needed to setup a VPC, as described 

nection servers 50 perform on-line traffic monitoring and 60 above, have to be specified here as well, along with the rules, 

decide based on the collected data. Since one of the func- A third approach is a VPC request from a network 

tions performed by the connection servers is to receive UNI administrator/manager. Each such request has to specify the 

signaling messages requesting switch virtual connection parameters enumerated above, for every pair of switches, 

(SVC) setup and determine routes within its PG to set up e.g., switches i and m, that have to be connected by one or 

SVCs, then each connection server CS, knows the number of 65 more VPCs. It should be understood that the three 

on-demand connections set up between each switch SW for approaches described are not mutually exclusive, and that 

which it is the primary connection server, and other switches combinations of the approaches are usually implemented. 
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Referring back to step 200 of FIG. 6, in order to physi- 1995, the whole contents and disclosures of each of these 

cally realize the VPCS, it is assumed that a connection server references are incorporated by reference as if fully disclosed 

50 needs to realize a sufficient number of VPCs between two herein. 

switches i and m with the given set of parameters defined M . . . n - 1rt CTr , - t „„c„ rmc 

_ Jz . . , r „_ Next, at step 210, rid. 7, the connection server pertorms 

above. Connection servers 50 and switch resource servers 75 5 , . • • c / u u-r. 

(FIG. 3) are involved in the VPC-realization phase. route compmauon usmg rouung information (reachab.hty 

C .1 , L t lLJ i - ij-l and the state of different elements) previously collected via 

FIG. 7 illustrates the general methodology involved in the r, KT KTT .* 1 L 1 * e u 

wnr , 4 . t ^ m^. r-i- , 1 . 4 PNNI routing protocol messages. It uses peak rates for each 

VPC realization step 200 of FIG. 6. First, as shown at step , 6 * . , r * r _ _ _ . r 

205 in FIG. 7, the connection server computes the number ™ ^ obtained from the [M y , R,.] source descriptions, 

of calls, v„ j e{l, . . . , k} that should be accommodated in 10 ^ ong ™ th ^ y f data ^ above > l ° dele "™ e ^ 

the VPCs, if this is not directly specified. Next, at step 210, bcst ( most ^ t0 succccd > shortcst P ath r01Jtcs for thc 

the connection server performs route computation for the and atlcmpts to set up the VPC along one of these 

VPC. Then, at step 215, the connection server apportions the routes - when considering that the example hierarchical 

end-to-end VPC CLR and CTD constraints among the network shown in FIG. 5, if connection server A.2.5 wants 

switches on the route. Once the constraints of each of the 15 "> set up a VPC between switches A.2.2 (for which A.2.5 is 

component switches along the route are calculated, then the the primary connection server) and B .3 -2. co nnectkm jserve r 

switch fabric for each switch has to be individually set-up, A.2.5 uses the information in its topology database to 

as indicated at step 225, FIG. 7. This step involves the switch compute a set of possible route s-andxxoxes &es eacti_as a 

resource servers 75 which perform the following four steps: "Designated Transit I ^ist f DTI , ,). S uppose, in this case, A.2.5 

connection admission control ("CAC"), VPI/VCI selection, 20 finds two routes: a first route including nodes (switches) 

switch fabric configuration, and setting runtime parameters. labeled, A.2.2, A.2.1, A.3, B and their and interconnecting 

At step 233, the connection server computes the residual physical links, and a second route having nodes A.2-2, 

delay and loss constraints for any more PGs having switches A-2 .3 f a.2.4, B and their links. It first attempts to set up the 

further down the route in the VPC using the actual delay/loss yp C along me first route For eX ample,iftheJ£C^^ 

guarantees reported by the switch resource servers. Finally, 25 calculated or speci fied aTacc5mn5oa5in e ^ calls, the 

a determination is made at step 235 as to whether there are TOwTol h necessary F o r this VPC ma y be 100 Mbits/s elTf 

any further PGs along the VPC route. If there are more PGs - jmk m ^ hrgt rQute> f x ^ nnecting nodes A.2.2. 153 " 

along the route, then the procedure returns to execute each -. mi. ■ .. — a — .-r ^ S- — - — - — : — wu-ri rr — 

r . b l1/liL i_n*r ■ „^ . tl _ it _ r A2.i, nas a bandwidtn capacity of only 60 Mbits/sec, then 

of steps 210 through 235 for each new PG along the path of — .„ r ; ~- ... ..... .» 

*i_ unn <Z t j • *u x 1 nr *u that route will be useless ana disregarded. Consequently, if 

the VPC. Once these steps succeed in the final PG, the 30 ,„ , , ? M ,.J„' > 

r • tu dp, ~( \mp will try setting uptnevPC along the second route. 

connection servers in the PGs 01 the VPC terminating ^ J _s — £ — 5 _ 

switches set appropriate tables in these switches enabling Details of DTL computation, which are a little different 

them to treat each other as logical neighbors. A detailed from PNNI, and the crankback procedure in case of resource 

description of the steps involved in realizing a VPC follows: reservation failures are now describ ed b y way of example.^ 

At step 205, FIG. 7, the connection server 50 needs to 35 [Referring to the hierarchical networK snown in FIG~ 5, If a 

determine the number of calls that must be accommodated VPC needs to be setup between switches A.2.2 and B.3,2, 

on these VPCs. This data may be directly provided in the then this VPC will straddle multiple PGs and intra-PG setup 

request or it may need to be inferred by the connection is done in parallel, with the PCC enhancement, and inter-PG 

server from the specified call blocking probabilities and setup is done sequentially. Assume that A.2.5 is the primary 

offered trafiEc. If the VPC type parameter indicates that the 40 connection server of switch A.2.2 and maintains VPCs for 

VPCs should be homogeneous, the connection server can which this switch is the originating point. A.2.5 uses the 

use- the Erlang-B formula, set forth in equation 1 as follows: information in its topology database to compute possible 

routes for this connection. These routes are expressed as a 

p Vj set of Designated Transit Lists (DTLs). Assume that A.2.5 

CBP Vj ! • eU k) 45 ^ nds ^ e f°ll° wm S two potential alternate routes: (A.2,2, 

; " ' = ' ! ' J A2.1, A3, B) or (A22, A.2.3, A.2.4, B). Further assume 

that connection server A.2.5 chooses (A.2.2, A.2.1, A.3, B) 
for its first realization attempt. It builds the following DTLs, 
in a stack, in accordance with the PNNI Specification 

„ „ . 50 Interface v 1.0, March 1996, however, is slightly modified to 

to compute the number of calls of each service class v^that accommodate me PCC enhancement. Thus, the DTL is 

needs to be accommodated on the VPCs. However, if the shown as- 
type parameter indicates that the VPCs should be 
heterogeneous, then one of various methods for computing 

multi-service class CBP can be used for the converse prob- 55 

lem of determining the total number of calls v ; , j e{l, . . . , pnni/pcc network: 

k}, from the specified CBPs and offered traffic p ; .. Such a v\Z-- 

determination may be found, e.g., in J. S. Kaufman, "Block- |JJ£J; [^j^L*' 3 ^ poirittr ' 2 

ing in a shared resource environment/' IEEE Trans. Comm., _! 

vol. 29, pp. 1474-1481, October 1995; J. -F. Labourdette 60 

and G. W. Hart, "Blocking probabilities in multi-traffic loss with the "Pointer" field in each DTL indicating the current 

systems: Insensitivities, Asymptotic behavior, and destination, except for the top DTL, DTL-1, where it is 

Approximations/' IEEE Trans. Comm., vol. 40, pp. advanced to the next destination. Note that these DTLs are 

1355-1366, August 1992; and G. L. Choudhury, K. K. slightly different from the DTLs that A.2.2 would be able to 

Leung, and W. Whitt, "An inversion algorithm for comput- 65 compute if it were using the PNNI signaling standard for 

ing blocking probabilities in loss networks with state- intra-PG connection setup wherein switch A.2.2 would 

dependent rates," in Proc. IEEE Infocom, pp. 513-521, compute the following DTL stack: 



z 
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Strictly PNNI network: 



work to choose aa alternate route. If it decides to attempt the 
'alternate route {A.2.2.Aj r 3. £l2A ~ES il.f nllnws a_ similar 
procedure" 

At step 215, FIG. 7, for each selected route, the connec- 

5 tion serve r .50 pp,crk tn appo rtion the end-to-end VPC CUR 
and CTD, for traffic class j, 6 ; - faf , x/ ot 7 respectively, among 
\ne switches on the route. This may be a complex problem, 
especially if switches from multiple vendors are to be 
since, A.2.2 does not know that A.2.1 has a neighbor, A.3.2, accommodated. Preferably, however, the connection server 
in PGA-3; only A.2.1 does. However, in the preferred *° may be equipped to provide more sophisticated solutions to 



DTL-l: [A.2.2, A.2.1 1 pointei-2 
DTL-2: [A.2, A.3] pointcr-2 
DT1^3: [A, B] pointer- 1 



20 



PNNIIPCC architecture, connection server A.2 .5, which 
receives PTSPs from A.2.1, knows this information, and 
hence computes the DTL as shown earlier for the PNNI/PCC 
network. A.2,5 then proceeds to process the top DTL in two 
phases. In the first phase it sends a Resources-Reserve 
message to the SRS in A.2.2 and A.2.1 in parallel, requesting 
them to set aside the specified resources to set up a VPC. 
Each SRS queues all such requests and processes them 
sequentially. This allows multiple connection servers to 
simultaneously contact an SRS without causing any dead- 
locks. Each SRS performs CAC functions (computing band- 
width and buffer resources as described above) and if it is 
able to satisfy a request for resources, the SRS sets aside 
these resources and marks them as unavailable. It also 
selects VPls to be used for this VPC. If successful, it sends 25 
a Resources-Available message back to the requesting con- 
nection server. If the requested resources are not available, 
it responds with a Resources-Unavailable message. 

Connection server A.2. 5 waits for a response from both 
switch resource servers. If the first phase is unsuccessful, it 30 
receives Resources-Unavailable messages from one or more 
switches. It then aborts processing the DTLs for the cur- 
rently chosen route, releases resources on switches which 
were successful in reserving resources, and then may 
attempt a different route. If the first phase is successful, it 35 
sends a Configure-Switch message in parallel to all the 
switches. An SRS receiving this message sets port/VPI 
translation table entries for the VPC as well as the necessary 
parameters for user plane algorithms such as cell scheduling. 

Once A.2.5 has successfully completed processing the 
current DTL, it updates the pointer in DTL-l at the top of the 
stack. The DTL stack then is configured as follows: 



solve this problem more effectively. For VPCs spanning one 
PG, the connection server knows the number of switches on 
the route, n, and hence can determine a maximum per-switch 
delay requirement for service class j, x j} to 



ignoring cell transfer delay along the link (which is typically 
very small). As an example, for a total end to end delay 
constraint of, e.g., 20 milliseconds along a route containing 
four nodes (switches), the algorithm translates this require- 
ment to a per switch constraint. In equal partitioning among 
all the switches in the route, each of the four (4) switches 
may be equally allocated a loss of, e.g., 5 milliseconds. 
Alternatively, the algorithm may decide to partition such 
constraints among the route nodes in an unequal fashion. For 
example, if a switch is loaded, then that node may be 
allocated a lower delay constraint, e.g., 12 milliseconds, and 
the next nodes along the route will have the remaining 8 
milliseconds allocated amongst themselves. 

For VPCs spanning multiple PGs, only an estimate of n, 
can be made by the connection server based on an estimate 
number of PGs the VPC passes through and an estimate of 
the number of switches in each, since it may not know the 
number of lowest-level PGs through which the VPC must be 
routed and find the exact number of switches in these PGs. 
A similar approach is used for dividing the end-to-end 
4Q VPC CLR, 8/°', for service class j among the n s switches on 
the route. If CLR constraint is equally distributed among the 
switches, the CLR constraint on each switch for service class 
j,6 y is derived from the following approximation set forth in 
equation (2) as follows: 



DTLrl: (A.2.2, A.2.1, A.3.2] poLntcr-3 
0TL-2: (A, B] pointer- 1 



45 



(1 - Bjf* = (1 - 0f) => Oj = 1 - {I - flf)* 



(2) 



The next hop is A.3.2 in PG A.3, Since A.3.3 is a connection 
server in A.3, A.2.5 sends a SETUP-SEGMENT message to 
A.3.3. The port/VPI selected on this interface between A.2.1 
and A.3.2 are parameters of this message. Note that a logical 
link exists between PGs A.2 and A.3, and a logical signaling 
link is pre -setup between the PGLs of these two PGs, 
namely A.2.5 and A.3.3. Even if this were not the case, 
signaling packets can be forwarded via datagram routers, 
such as IP routers or Signaling Transfer Points ("STPs"). 

A.3.3 deletes the top entry and the DTL stack now 
becomes: DTL-l: [A, B] pointer- 1. A3 .3 needs to route the 
connection to reach PG B to the final destination B.3.2, 
Switch A.3 3 uses the two phase approach to set up the 
connection through A.3.2 . Let us assume that A.3.2 does not 
have enough resources and this fails. A.J.J now starts""a 
"c rankback procedure by sending a Release message back to^ 
connectio n sp.rvr.r A 7 fi, which, in turn, uses a parallel, 
r elease approach and communicates with each SRS on the 
VPC and releases resources. A.2.5 then examines the nct- 



Once the constraints of each of the component switches 

so are determined along the path, then the switch fabric for 
each switch has to be individually set up, which is a four step 
process as mentioned above with reference to step 225, FIG. 
7. Specifically, the VPC switch fabric within a peer group 
(PG) is setup sequentially, in accordance with the PNNI 

55 protocol. Furthermore, inter-PG setup is accomplished 
sequentially from one PG to the next. Preferably, however, 
with the PCC protocol enhancement, switch fabric for 
switches within a PG may be performed in parallel, with the 
information downloaded from the connection server to each 

60 switch within the peer group. In this instance, connection 
setup within a PG consists of two phases: a resource 
reservation phase, as shown in FIG. 8(a), and a fabric 
configuration phase, as shown in FIG. 8(6). In the resource 
reservation phase, the connection server sends a ReserveRe- 

65 sources message 232 to the SRSs (Switch Resource Servers) 
for the switches of the selected route, (in parallel), request- 
ing them to set aside the necessary resources. Each SRS that 
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receives such requests pushes them into a queue and pro- 3) the upperbound on the CLR, represented by line 244 in 

cesses them sequentially. This allows multiple connection FIG. 9, that the connection can experience at this 

servers to simultaneously contact an SRS without causing switch; and 

any deadlocks. Each Reserve-Resources message 232 speci- 4) the maximum buffer space, b avaih available at the 

fies the parameters [Mj, Rj], 6,., t,- and v y for each service 5 switch (for this connection). 

class j. Each SRS then performs CAC (Connection Admis- Wh n e Equation 4 illustrates the choice of buffer and 

sion Control) functions to determine if it can satisfy the bandwidth in order to minimize the bandwidth allocation, in 

request However to do this, the SRS must determine the n{ me SRS ^ free tQ choose buffer size and 

required bandwidth and buffer resources from the param- bandwidth that Ues insidc rcgion 240 . Notc that points on the 

eters specified in the Reserve-Resource message. Jrt . . . , . CTO „ , J* £ ■ ■ ■ 

In DIVA, buffer and bandwidth allocations are performed 10 ^nts indicated in FIG. 9 as w-x and x-y satisfy both the 

simultaneously. Given a buffer of size «b" cells which is d u cla y a " d C P constrain u ts ^re such that lowering either 

being emptied at a constant rate of V cells/second, as ll \ e b ^ c I allocation or the bandwidth moves the switch out 

depicted in FIG. 2, it is evident that the maximum delay, x, of thc feasible region 240. In this sense, these points 

experienced by a cell from the time it enters the buffer to the correspond to minimum resource allocations. However, the 

time it leaves the buffer, is 15 SRS might choose a point inside the region 240, thus, 

realizing a better delay/CLR than the constraints specified. 

b Such a choice effectively eases the constraints on the 

• * switches further down the route of the VPC and increases the 

probability that the VPC will be successfully routed. 

m „ , , „ „ n , 20 The above-described technique assumes that bandwidth 

Thus, the other constramt on b arises from the CLR required, allocations are made assuming statistical mu i tip i e xing is 

,n accordance wnh equat.on (3) as follows. exploited Qn ^ syc a[)d among sey6ra] svc / route | on 

a VPC. This assumption can be made for homogeneous 

t s Tj ^ VPCs. It has been observed, however, that for heterogeneous 

c 25 VPCs, call-level statistical multiplexing gains achieved by 

establishing SVCs of different service classes on a VPC can 

If the cells of a (set of) connection(s) are queued in a switch be negated by requiring all service classes to be treated in the 

buffer of a certain size b, for a specified CLR (e.g., 6), the same manner as the service class with the most stringent 

equivalent bandwidth of this (set of) connection^), c eg> is requirements. Hence, for heterogeneous VPCs, no call-level 

the constant rate at which the buffer has to be emptied such 30 multiplexing is assumed, i.e., peak rate bandwidth alloca- 

that the probability of buffer overflow is 6. It is understood t j ons are made determined directly from the [M y , R ; ] source 

that the bigger the buffer size b, the smaller the rate at which characterization. The buffer allocation is determined from 

the buffer has to be emptied (the equivalent bandwidth) to the pe r-switch delay constraint. Peak rate allocations imply 

maintain a given CLR. The < expression fore as a function ^ cell loss> which implicitly meets cell loss con „ 

of b, 6 and the statistical characteristics of the (set or) 35 stra j Dt 

connection(s) has been derived and skilled artisans may Af . n j u ,-a*u a u «- 

v \ c . 4 c t , , - 4 . J After computing the required bandwidth and buffe r 
avail themselves of a variety or methods for computing - _ j- ■ Tum a i .l 1 . l ^ ' 
equivalent bandwidth. The equivalent bandwidth of a set S* resources ir ine^K^ aetermines that it has^fi^ 
of n connections with the same statistical characteristics, is resources to meet t^se requirements^ sets aside these 
denoted as a function of b and 6 such that c fb,e, SJ. If resources and m ayhem as unavailable. It also selects 
bandwidth resources are scarce, the total bandwidth 40 A^is to oe used tor tms vru. it men sends a Resources- 
assigned to the (set of) connection(s), c (b,6, S„) must be Available message back to the requesting connection server, 
minimized. Since the equivalent bandwidth formula is a If the requested resources are not avail able, it responds with 
decreasing function of b, and given equation (3) it is a Resources -Unavailable message. 

determined that the value of b satisfying the delay bound and "In the example hierarchical network described with ref- 

minimizing the bandwidth requirement is the minimum of 45 erence to FIG. 5, connection server A.2.5 will send Reserve - 

(a) the maximum buffer size b max available at the switch for Resources messages to switches A.2.2 and A.2.1, both inside 

the VPC, and (b) the solution of the equation (4) which has its PG(A.2). Node A.2.5 then waits for a response from each 

a unique positive solution and is set forth as follows: SRS contacted. 

In FIG, 8(b), if the first phase is successful, then the 

b (4 ) 50 connection server, e.g., A.2.5 in the example network of 

Ceqib, 6 jt s») = Tj FIG. 5, enters the second phase by sending a Configure- 

Switch message 242 which are executed by all the switches 
on the route within its peer group, as indicated in FIG. 8(b). 

FIG. 9 shows the relationship between the allocated Specifically, when implementing the PCC protocol, a 

bandwidth (vertical axis) and buffer (horizontal axis), and ss Configure-Switch message 242 is sent in parallel to all the 

the CLR and CTD constraints on the switch. The shaded SRS switches in the route. An SRS receiving this Configure- 

region 240 shows the range of allowed values for the buffer Switch message 242 sets port/VPI translation table entries, 

size b and bandwidth c^ such that all the constraints are j t configures the switch fabric to realize the VPC. It also 

satisfied. This region is computed based on the following se ts buffer allocations for the VPCs (assuming per- VP 

bounds: 60 queuing in the nodes) and provides the allocated bandwidth 

1) an upperbound o max on the bandwidth to be allocated to the switch scheduler for enforcement. 

to the VPC which is the minimum of the maximum For multi-PG VPCs, a connection server 50 in p ^ 

bandwidth, c avaU , available on the outgoing link, and performs this two phase setup approach (illustrated in pIGS. 

the peak rate, c^ ak> of the traffic using the VPC; ~S(g) and 8(b)) for the switches inits PG. Specifically, once 

2) the upperbound on the cell delay, represented by line 65 responses carrying actual delay guarantees are received by 
243 in FIG. 9, that the connection can experience at this the connection server 50, it uses these to compute the 
switch; and, residual constraints to be satisfied by switches in PGs further 
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down the route, as indicated at step 233 in FIG. 7. If the attempt to increase bandwidth fails, the connection 

Specifically, the real numbers are obtained and reported back server attempts to set up a new VPC between this pair of 

to the connection servers which re-calculate the delay and switches on a new route. 

loss constraints, and subtracts them off the estimated values Finally, as indicated at step 320 in FIG. 6, DIVA provides 

for the nodes, to send it further down the road to the next 5 for dyn amically changing the VPC to accommoaate time and 

connection server. PG to PG setup proceeds sequentially noae aaamo ns and failur es, addition of a sw itch, connectio n 

using PNNI signaling messages for communication between s erver orTink, amTiaiiure of a switch, connection server or 

connection servers in different PGs. Unlc. Tniscly nam ic process rat step 320 will now be described 

Once the above st eps 210-233 in FIG. 7 are completed "^fTTflore detail with respect to FIGS. 10(a) and 10(6). 

successfully in the last PG' along the r6ute or tne" vFCT io As shown at step 322 in FIG. 10(a), a determination is 

appropriate, data tables are created at the Vru terminating made as to whether a new link has been added to the network 

" switches. bV-Jhc connection servers in the PGs_of thes e comprising the VPC. If a new link is added, the switches on 

switches, to_ enable them to tre attach other as "logicall y either side of the newly added link inform their respective 
^ " '"- , 1, SWI and 



connected *' neighjaprs..For the example, in FIG. 1, primary connection servers about the new link, as indicated 

"SW2 will be programmed with the appropriate data to 15 at step 322. These connection servers in turn flood this 

enable SVC route computation algorithms to treat them as information among other connection servers in the PG, 

logically connected neighbors. which information also passes up the hierarchy if the link is 

The next step, as indicated as step 310 in FIG. 6, is to between PGs. Thus, at step 333, the new link is added to the 

determine whether on the fly adjustments are to be made to topology databases of all the necessary connection servers in 

VPC routes and resource allocations. As indicated at step 20 the routing domain, thereby enabling the connection servers 

300 in FIG. 6, this is done using one of two approaches: by to start using the link for routing future connections, 

monitoring call blocking probabilities or by monitoring VPC At step 325, a determination is made as to whether a new 

cell usage. Using the periodic updates received from each switch, e.g., switch S, has been added (it may be a new 

switch SW for which it is the primary connection server, switch or a failed switch being restored after repair). If so, 

each connection server 50 monitors the state of each VPC 25 then it starts the Hello protocol over each of its outgoing 

associated with the switches. For example, it be the case that links. Simultaneously, at step 335, it requests a list of 

efficient bandwidth utilization is set to be between 80% and connection servers in its PG from its neighbors. Once it 

90%. If VPC usage goes beyond this percentage, e.g., the receives this information, switch S sends a Register message 

VPC may start blocking calls; if it goes below this to a chosen connection server (using packet routing, for 

percentage, the VPC resources are being under utilized. In 30 example, as explained earlier) CS C , informing it of its status 

either case, corrective action may be taken by decreasing as a newly added node and requesting that it be assigned a 

bandwidth allocation for a VPC, in the case of under- primary connection server, as indicated at step 337. Then at 

utilization, or, e.g., provisioning another VPC, i.e., another step 339, CS C chooses the least loaded connection server, in 

route, between the same two nodes, in the case of over- its estimation, CS^, in the PG, and forwards the Register 

utilizing VPC resources. 35 message to CS^ which then establishes a direct logical 

More specifically, if, in a predetermined time-frame, signaling link with S and informs S about it. Once this link 

either (a) the observed CBP $ meas on a VPC is not within a is established, S starts sending periodic PTSPs on this link 

specified range [(1-p j ( l+p J] where the target CBP for to CS^, as indicated at step 341. The other connection 

the VPC is p, or the average occupied bandwidth c occ is not servers in the PG know about S and topology state infor- 

in the range [minxc 0<:W , maxxc jJC/Mfl/ ], the primary connec- 40 mation associated with S from the PTSPs flooded periodi- 

tion server 50 of one of the terminating switches of the VPC cally by CS p in the PG, 

takes corrective action. At step 327, a determination is made as to whether a new 

When p^^l-p^xp or c occ <minxc acrufl/ , it attempts to connection server, CS M comes up. If a new connection server 

reduce the allocated bandwidth. The connection server uses has been added, it contacts its neighbors (which may be 

the two-phase approach described above with reference to 45 switches or other connection servers) to determine the 

FIGS. 8(a) and 8(b) to realize this adjustment of lowering address of other connection servers in the PG, as indicated 

the assigned bandwidth (expressed as a percentage in the at step 328. Then, at step 329, it proceeds to contact them 

Reserve -Resources message). The exception to this band- and establish logical links to some or all of them and 

width reduction step is when the VPC bandwidth is smaller performs a topology database copy. Then, as indicated at 

than a minimum c min . In such a case the connection server 50 step 330, it starts receiving PTSPs from other connection 

marks the VPC as "frozen". No more connections are servers and proceeds to do the same. As indicated at step 

admitted on this VPC and it is allowed to empty out. When 331, other connection servers in the PGs may use a "hand- 

the last call completes, the VPC is torn down and the shake" protocol to off-load some of the switches they are 

resources recovered. currently responsible for to the newly added connection 

On the other hand, when the bandwidth is inadequate to 55 server which is lightly loaded, 

support the required CBP and P mea5 >(l+p M )xp or c occ >maxx As shown at step 350, in FIG. 10 ..(b) a determination is , 

Q actuai> tne connection server attempts to increase the band- made as to whether the re r was a, link failure in.a_VECj:Dutii. 

width assigned to the VPC. This is also done using the As indicated at step 350, link J^lu^Sj Wj^ch^may^beJjoth 

two-phase approach described above with reference to mtermittent anc L permanenUmay be dete cted bv_Operatioa 

FIGS. 8(a) and 8(b), Particularly, in the first phase, the 60 andMai ntenance (QAM) funct ions executed at different 

connection server contacts the first switch in the peer group levels oflne network ffi 

which sends the necessary information to each of the "DAM, ATM VP and VC layer 6 AM. Details of the Opera- 
switches along the route to request the increase in band- tion and Maintenance functions may be found in the refer- 
width. Preferably, the PCC protocol is implemented so that ence ITU-T: Recommendation 1.610, B-fSDN Operation 
the connection server contacts all of the switches in parallel 65 and Maintenance Principles and Functions, Rev. 1, Geneva, 
requesting an increase in bandwidth (again, expressed as a 1993. Additionally, Hello packets running at the PNNI 
percentage). In the second phase, it sends a commit request. routing protocol layer aid in detecting failures because, 
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when a link goes down, for example, the nodes on either side 
of the link stop receiving Hello "heartbeat" packets from the 
node across the link and pass this information up to their 
primary connection servers. As indicated at step 363, the 
connection servers will receive the alarm and failure mes- 
sages from OAM to determine the source of the link failure. 
Correlating the alarms and failure indication messages 
received from different levels of the hierarchy and deter- 
mining their cause is a complex problem, however, the 
connection server may implement one of the available 
algorithms for solving this problem. For instance, the algo- 
rithm described in I. Katzela and M. Schwartz, "Fault 
identification schemes in communication networks," IEEE 
Trans. Networking, December 1995, incorporated by refer- 
ence as if fully set forth herein, may be used to determine the 
failed network element. For example, using the information 
about missing Hello packets, the connection servers could 
determine the link that has failed. This information is then 
flooded, inside the network, as indicated at step 365, and 
eventually reaches the topology databases of necessary 
connection servers which then do not use the failed element 
in computing future routes. Additionally, as indicated at step 
367, w hen a connection serve TCS de tenuities In at a'linicj 
Tas faflea; it reroutes ariv VHJs !hai_it is monitoring, which 
"use this link, by re t urning to step 210, FIG. 7. Other wise, 
the monitonng process continues. The reuse of signaling 
software for VPC setup/modification and PCC for fast 
connection setup are the two aspects of DIVA that enable 
fast restoration of VPCs. 

As shown at step 353, in FIG. 10 (b) a determination is 
made as to whether there was a switch failure. The failure of 
a switch is equivalent to the failure of all the links around it. 
Thus, as indicated at step 355, the node having the failed 
switch is marked unreachable by the connection servers and 
is not used for routing connections. 

At step 357, FIG. 10(b), a determination is made as to 
whether there was a connection server failure. If there was 
a connection server failure, then, at step 359, each switch 
SW for which it was the primary connection server goes 
through the procedure followed by a switch that is newly 
added to the network, e.g., as explained above at step 335, 
FIG. 10(a). Thus, Switch SW simply chooses another con- 
nection server CS 2 as its primary connection server, and 
starts sending their PTSPs to CS 2 . 

The foregoing merely illustrates the principles of the 
present invention. Those skilled in the art will be able to 
devise various modifications, which although not explicitly 
described or shown herein, embody the principles of the 
invention and are thus within its spirit and scope. 

What is claimed is: 

1. Dynamic virtual path connection management system 
in a hierarchical ATM network comprising: 

a) means for obtaining parameters characterizing a virtual 
path desired to be provisioned between said two 
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2. Dynamic virtual path connection management system 
according to claim 1, wherein said route of said virtual path 
connection includes one or more switches and interconnect- 
ing links, said means for computing including means for 
allocating bandwidth and buffer size resources among each 
said one or more switches along said route. 

3. Dynamic virtual path connection management system 
according to claim 1, further comprising a first message 
routing scheme for communicating messages sequentially 
between each said switch of said route. 

4. Dynamic virtual path connection management system 
according to claim 3, further comprising a second message 
routing scheme for simultaneously communicating resource 
allocation messages in parallel from said computing means 
to each of its associated switches along the route. 

5. Dynamic virtual path connection management system 
according to claim 2, further including a switch server 
associated with a switch along said route, said switch server 
for receiving resource allocation messages from said com- 
puting means and for configuring its associated switch in 
accordance with bandwidth and buffer resource constraints. 

6. Dynamic virtual path connection management system 
according to claim 1, further including means for monitoring 
service usage along said route of said realized virtual path 
connection, whereby said computing means re-allocates said 
resources of said virtual path connection for accommodating 
on demand service changes along said route. 

7. Dynamic virtual path connection management system 
according to claim 6, wherein said means for monitoring 
service usage of said virtual path connection includes moni- 
toring on demand service requests at each said switch for a 
predetermined window of time, each said switch server 
associated with a respective switch communicating status of 
said switch to said computing means. 

8. Dynamic virtual path connection management system 
according to claim 2, wherein said computing means com- 
pares said bandwidth resources of a particular switch with 
first and second predetermined threshold values, and com- 
municates a message to said particular switch to decrease 
bandwidth allocation of said switch when said virtual path 
connection usage at said switch falls below said first pre- 
determined threshold or, increase bandwidth allocation of 
said switch along said route when said virtual path connec- 
tion usage at said switch increases above said second 
predetermined threshold. 

9. Dynamic virtual path connection management system 
according to claim 2, wherein said computing means com- 
putes a new virtual path connection between said two nodes 
when a prior computed route for said virtual path connection 
is unable to achieve computed bandwidth resource alloca- 
tions. 

10. Dynamic virtual path connection management system 
according to claim 1, further including means for determin- 
ing whether there are physical failures or additions of one of 
interconnecting links, nodes, or primary servers elements in 



switching nodes in said network and communicating 5S said ATM network, and communicating information of 



said parameters to a first control device associated with 
a said switching node in said network; 

b) means for communicating information relating to 
switching element resources currently available at each 
switching node contained in said network to said first 
control device; 

c) means for computing from said parameters and switch- 
ing element resource information an optimal route 
between said two switching nodes that is capable of 
realizing a virtual path connection there between; and, 

d) means for allocating switching element resources for 
switching elements contained in said computed route. 



failed or added elements via said first message routing 
system to other nodes in the system. 

11. Method for automatically provisioning a communica- 
tion channel between two switching nodes of an ATM 
network including a plurality of interconnected switching 
nodes, each said switching node including at least a switch- 
ing element and an associated switch control device; said 
method comprising: 

a) providing at least two connection servers for path 
management in said ATM network; 

b) associating each said switching node with one of said 
at least two connection servers; 
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c) obtaining parameters characterizing said communica- 
tion channel, said parameters includes end-to-end Cell 
Loss Ratio and Cell Transfer Delay between said two 
switching nodes of said ATM network; 

d) communicating said parameters to a first connection 
server associated with a said switching node in said 
network; 

e) periodically communicating information relating to 
switching element resources currently available at each 
switching node contained in said network to said first 
connection server; 

f) from said parameters and periodically communicated 
current switching element resource information, com- 
puting an optimal route between said two switching 
nodes that is capable of realizing said communication 
channel and apportioning end-to-end Cell Loss Ratio 
and Cell Transfer Delay among said switching ele- 
ments along said optimal route, and allocating new 
switching element resources for switching elements 
contained in said computed route; and 

g) communicating allocated switching element resources 
Lo each switch control device associated with a switch- 
ing node along said route, each said switch control 
device configuring a respective switching element to 
maintain said new switching resources allocated 
thereto. 

12. Method for automatically provisioning a communi- 
cation channel according to claim 11, wherein said end-to- 
end Cell Loss Ratio is apportioned equally among said 
switching elements along said route. 

13. Method for automatically provisioning a communi- 
cation channel according to claim 11, wherein said end-to- 
end Cell Transfer Delay is apportioned equally among said 
switching elements along said route. 

14. Method for automatically provisioning a communi- 
cation channel between two switching nodes of an ATM 
network including a plurality of interconnected switching 
nodes, each said switching node including at least a switch- 
ing element and an associated switch control device; said 
method comprising: 

a) providing at least two connection servers for path 
management in said ATM network; 

b) associating each said switching node with one of said 
at least two connection servers; 

c) obtaining parameters characterizing said communica- 
tion channel; 

d) communicating said parameters to a first connection 
server associated with a said switching node in said 
network; 

e) periodically communicating information relating to 
switching element resources currently available at each 
switching node contained in said network to said first 
connection server; 

f) from said parameters and periodically communicated 
current switching element resource information, com- 
puting an optimal route between said two switching 
nodes that is capable of realizing said communication 
channel and allocating new switching element 
resources for switching elements contained in said 
computed route; and, 

g) communicating allocated switching element resources 
to each switch control device associated with a switch- 
ing node along said route, said communicating per- 
formed sequentially between each switching node 
along said route by means of a PNNI message routing 
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scheme, each said switch control device configuring a 
respective switching element to maintain said new 
switching resources allocated thereto. 

15. Method for automatically provisioning a communi- 
cation channel between two switching nodes of an ATM 
network including a plurality of interconnected switching 
nodes, each said switching node including at least a switch- 
ing element and an associated switch control device; said 
method comprising: 

a) determining where to set up said communication chan- 
nel by monitoring online traffic between end nodes and 
determining a number of connection setup requests 
over a certain window of time; 

b) determining whether said number of connection setup 
requests exceeds a predetermined threshold; 

c) computing a route between said end nodes by providing 
at least two connection servers for path management in 
said ATM network, associating each of said switching 
node with one of said at least two connection servers 
and obtaining parameters characterizing said commu- 
nication channel; 

d) communicating said parameters to a first connection 
server associated with a said switching node in said 
network; 

e) periodically communicating information relating to 
switching element resources currently available at each 
switching node contained in said network to said first 
connection server; 

f) from said parameters and periodically communicated 
current switching element resource information, com- 
puting an optimal route between said two switching 
nodes that is capable of realizing said communication 
channel and allocating new switching element 
resources for switching elements contained in said 
computed route; and, 

g) communicating allocated switching element resources 
to each switch control device associated with a switch- 
ing node along said route, each said switch control 
device configuring a respective switching element to 
maintain said new switching resources allocated 
thereto. 

16. Method for automatically provisioning a communi- 
cation channel between two switching nodes of an ATM 
network including a plurality of interconnected switching 
nodes, each said switching node including at least a switch- 
ing element and an associated switch control device; said 
method comprising: 

a) providing at least two connection servers for path 
management in said ATM network; 

b) associating each said switching node with one of said 
at least two connection servers; 

c) obtaining parameters characterizing said communica- 
tion channel; 

d) communicating said parameters to a first connection 
server associated with a said switching node in said 
network; 

e) periodically communicating information relating to 
switching element resources currently available at each 
switching node contained in said network to said first 
connection server; 

f) from said parameters and periodically communicated 
current switching element resource information, com- 
puting an optimal route between said two switching 
nodes that is capable of realizing said communication 
channel and allocating new switching element 
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resources for switching elements contained in said route includes communicating allocated switching element 

computed route, resources sequentially between nodes of one group to nodes 

g) allocating bandwidth resources for each switching located in subsequent groups. 

element by: determining an upper threshold on the 24. Method for automatically provisioning a communi- 

bandwidth to be allocated, said upper threshold being 5 cation channel according to claim 11, wherein said switch- 

the minimum of the maximum bandwidth available on in g element resources include bandwidth and buffer size of 

an outgoing link from a switch and the peak rate of the SJud switching elements, each said switch control device 

traffic along said computer route, determining upper configuring a respective switching element to maintain new 

thresholds on the Cell Transfer Delay and Cell Loss bandwidth resources allocated thereto. 

Ratio that the connection can experience at a particular 1° 25. Method for automatically provisioning a communi- 

switch, and determining the maximum buffer space cation channel according to claim 24, further including the 

available at said particular switch; ste ps °f ; 

h) communicating allocated switching element resources h) monitoring switching element resource usage along 
to each switch control device associated with a switch- sa id route °f sa id communication channel; and 

ing node along said route, each said switch control 15 i) re-allocating said switching element resources of nodes 

device configuring a respective switching element to contained along said route for accommodating on 

maintain said new switching resources allocated demand service changes along said route, 

thereto. 26. Method for automatically provisioning a communi- 

17. Method for automatically provisioning a communi- cation channel according to claim 25, wherein said moni- 
cation channel according to claim 11, wherein said step g) of 20 toring step h) includes continually repeating steps c), d) and 
communication allocated switching element resources to e). 

each respective switch control device includes communicat- 27. Method for automatically provisioning a communi- 

ing allocated switching element resources sequentially cation channel according to claim 26, wherein said 

between each said switching element of said route. re-allocating step i) includes comparing said bandwidth 

18. Method for automatically provisioning a communi- 25 resource information with a predetermined threshold and 
cation channel according to claim 11, wherein said ATM increasing said bandwidth resources of one or more switch- 
network implements a message routing scheme for sequen- ing elements along said route when on demand service along 
tially communicating allocated switching element resources said route increases above a predetermined threshold, and 
between each respective switch control device along said decreasing said bandwidth resources of a switching element 
route. 30 along said route when on demand service along said route 

19. Method for automatically provisioning a communi- decreases below a predetermined threshold. 

cation channel according to claim 17, wherein said first 28. Method for automatically provisioning a communi- 

connection server is associated with one or more of a group cation channel according to claim 27, wherein said 

of switching nodes, said step g) of communicating allocated re-allocating step i) includes increasing said buffer quantity 

switching element resources to each respective control 35 of a switch along said route when on demand service along 

device includes communicating allocated switching element said route increases above a predetermined threshold, 

resources substantially simultaneously from said first con- 29. Method for automatically provisioning a communi- 

nection server to each said switch control device of an cation channel according to claim 25, wherein said 

associated node computed as part of said route. re-allocating resources step i) includes computing a second 

20. Method for automatically provisioning a communi- 40 route between said two nodes by repeating steps c) through 
cation channel according to claim 17, wherein said first 0 when on demand service along said route increases above 
connection server maintains topological information regard- a predetermined threshold. 

ing status of switching element resources for nodes in said 30. Method for automatically provisioning a communi- 

computed route. cation channel according to claim 11, wherein said param- 

21. Method for automatically provisioning a communi- 45 eters characterizing said communication channel between 
cation channel according to claim 17, wherein said ATM said two nodes include a number of calls to be accommo- 
network is organized as groups of interconnected nodes, said dated in the communication channel. 

first connection server maintaining topological information 31. Method for automatically provisioning a communi- 

regarding status of switching element resources for its cation channel according to claim 11, wherein the comput- 

associated group of nodes in said computed route. 50 ing step further includes obtaining parameter data compris- 

22. Method for automatically provisioning a communi- ing specified call blocking probabilities and offered traffic 
cation channel according to claim 21, wherein said ATM and calculating thereform the number of calls accommo- 
network contains one or more groups of nodes organized in dated by the communication channel. 

a first hierarchical level, each said group of nodes having an 32. Method for automatically provisioning a communi* 

associated connection server for communicating in a second ss cation channel according to claim 25, wherein said moni- 

hierarchical level, said method further including the step of toring step further includes the step of determining whether 

communicating topological information of available switch- there are physical failures or additions of one of links, nodes, 

ing element resources contained in nodes between connec- or connection servers in said ATM network, 

tion servers of each associated one or more groups of nodes 33. Method for automatically provisioning a communi- 

at said second hierarchical level. 60 cation channel according to claim 32, wherein said message 

23. Method for automatically provisioning a communi- routing scheme includes exchanging information to estab- 
cation channel according to claim 22, whereby a computer lish an identity for a said switch and a corresponding 
route contains switching nodes located in different groups, connection server for said switch in said ATM network, 
said step g) of communicating allocated switching element 

resources to each receptive switch control device along said ***** 
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